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Abstract — In this paper, relaxed belief propagation (RBP) 
based detectors are proposed for multiple-input multiple-out 
(MIMO) system. The factor graph is leveraged to represent 
the MIMO channels, and based on which our algorithms are 
developed. Unlike the existing complicated standard belief prop- 
agation (SBP) detector that considers all the edges of the factor 
graph when updating messages, the proposed RBP focuses on 
partial edges, which largely reduces computational complexity. 
In particular, relax degree is introduced in to determine how 
many edges to be selected, whereby RBP is a generalized edge 
selection based BP method and SBP is a special case of RBP 
having the smallest relax degree. Moreover, we propose a novel 
Gaussian approximation with feedback information mechanism 
to enable the proposed RBP detector. In order to further improve 
the detection performance, we also propose to cascade a minimum 
mean square error (MMSE) detector before the RBP detector, 
from which pseudo priori information is judiciously exploited. 
Convergence and complexity analyses, along with the numerical 
simulation results, verify that the proposed RBP outperform 
other BP methods having the similar complexity, and the MMSE 
cascaded RBP even outperform SBP at the largest relax degree 
in large MIMO systems. 



I. Introduction 

Although belief propagation (BP) is rooted in artificial intel- 
ligence, it has attracted vast attentions among communication 
theorists since the argument that decoding of the celebrated 
turbo code as an instance of BP [1 1. In the past decade, graph 
models and BP have been embedded in many contexts of com- 
munication literature, such as coding theory [2 1, equalization, 
multi-user detection [3| and signal processing [4|. One of the 
most concerned issues is that for graphs having many circles, 
BP does not converge, thereby poor performance and high 
complexity become the main drawbacks (5). 

We consider the detection problem in multi-input multi-out 
(MIMO) systems. Various detection algorithms have long been 
proposed like zero forcing (ZF), minimum mean square error 
(MMSE) and serial interference cancellation (SIC). In terms of 
BP's compatibility with other problems such as decoding and 
channel estimation, BP has been applied for MIMO detection 
recently |6|-[9]. The graph model of MIMO channels is a 
complete graph where each variable is connected to all the 
other variables, which means the graph has the most circles 
among the graphs having the equivalent variables. Standard BP 
in these complete graphs achieves poor performance [151, |f7|, 
or possesses high complexity [8|. Thereby designing message 
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and message update rule of BP become the main issues for 
achieving good performance with low complexity. 

The main contribution of our work is that we develop the 
present BP based algorithms, bring in edge selection policy, 
some approximation ideas and obtain some methods which 
outperform other BP based methods. [6] proposed an algorithm 
based on markov random field (MRF) model, but with very 
poor performance (see FigJ3). [8| proposed the factor graph 
model of MIMO channels and the corresponding standard BP 
algorithm, although it can achieve near optimal performance, 
the complexity of it is even higher than maximum likelihood 
(ML) detector. Some low complexity BP algorithms based 
on edge selection are proposed in [8| as well, while the 
edge selection policy and approximation method need to be 
improved. Some other low complexity algorithms are also 
proposed recently in Q, ||9], we take the cue from these 
algorithms, combined with our original ideas to design the 
message on factor graph, and modify some key points. More- 
over, the message update rule and edge selection policy of [8] 
is redesigned by us. In particular, relax degree is introduced 
in to determine how many edges to be selected, whereby the 
proposed RBP is an adaptive method for tradeoff between 
performance and complexity. 

Numerical simulation results under different antennas, dif- 
ferent relax degree and different iterations are analyzed and 
compared. Meanwhile, convergence are also analyzed with the 
help of average mutual information (AMI). 

The rest of this paper is organized as follows: Section 
II describes a system model. Section III presents the factor 
graph representation of MIMO channels and a brief review of 
standard BP detector. Section IV introduces the proposed re- 
laxed BP algorithms and their performance simulation results. 
Convergence and complexity analyses are presented in Section 
V. Finally, conclusions are provided in Section VI. 

II. System Model 

Supposing there are N t transmit antennas and N r receive 
antennas, data sequence is separately modulated and sent 
through each transmit antenna. Frequency-flat fading channel 
is considered here and the channel is formulized as 



y = H-s + n, (1) 

where yjv r xM = {yi,V2,--- ,yN r ) T is the received vector, 
H-N r xN t = [hf , hj, • • ■ ] is the matrix representa- 
tion of the channel with the elements hj t k denoting the 
channel gain from transmit antenna k to receive antenna 



j and has the distribution hj t k ~ CAT (0,1), n^xM = 
{ni,n2,--- ,njy r ) T is additive Gaussian noise vector whose 
elements satisfy CW(0, cr 2 ), sjv t xM = (s%,S2,-" , s N t ) T is 
the transmitted symbol matrix with each symbol independently 
selected from a set of constellation A . The transmitted 
bit vector is thus x = {x\,X2,--- ,XMN t ) 7 \ where Sf- = 
(xkM-M+i,XkM-M+2, • • ■ ,x kM ) T , k = l,2,---,N t and 
Xi e {+1,-1}, i = 1,2,- •• , MN t . The jth receive signal 
is then expressed as 



h, : ■ S 



MN t 

E 



(2) 



where fc (i) = 1 + [(« — 0.5) /MJ denotes the subscript of 
channel gain for bit £i. 

We assume that all channel coefficients are independent 
from each other and are known only at the receiver side. 

III. Graph Models and Standard BP 

A. Factor Graph for MIMO channels 

Factor graphs can describe all the relationships between 
variables easily, one for MIMO channels is represented in 
Fig[TJ bit nodes {xi,X2, • ■ ■ ,XMN t } correspond to the trans- 
mitted bits, factor nodes {/1, f%, ■ ■ • , fjf r } represent the rela- 
tionships between received signal and transmitted bit nodes. 




Figure 1. Factor graph model for MIMO channels, where a and /3 are 
messages passing between the bit nodes and factor nodes. 



B. Standard BP on Factor Graph (SBP) 

The essentials of SBP on factor graph lie in two steps at 
each iteration, first each bit node passes its a priori message to 
the connected factor nodes, second each factor node updates its 
a posteriori message according to a priori messages, and then 
passes it back to each bit node. When bit nodes received the 
messages from factor nodes, they update their a priori informa- 
tion as well. In the following analyses, log likelihood ratios 
(LLR) are used for message design, let j = 1,2,- •• ,N r , 
i = 1,2, ■ • • ,MN t , x"\* = (xx,- ■ ■ ,x t -i,x t+ i, ■■■ ,x„) and 
1Z (x) denotes the real part of x. 

1 ) Message Design: For each bit nodes, LLR of each bit's 
a priori probability in s is used as the message a which passes 
to the factor nodes. The message passing from Xi to fj at Zth 
iteration is 



(0 - i og P Q) 0* = 



h3 



p(0 {xi = -1)' 



(3) 



Assume that input bits are independent, then at the Zth 
iteration, the message sent from fj to Xi, representing a 
posteriori probability of signal and denoted by f3, can be 
calculated as follows: 



= log 



Xi = -1\ Vj,hj) 



(4) 



Es:, I'Uh S.h,lV (X^V) 

Using the approximation log (e x + e y ) w max (a;, y), we get: 




(5) 



where the function Dj (s) is defined as 

D S (s) 4 log (p ( Vj I s, h,-)) oc ~ || Vi - h jS f . (6) 

2) Message Update Rule: (0 actually gives the message 
update rule of f3, on the other hand, the update rule of a is 



N r 



- E Pi 



(7) 



which is the standard BP message update rule. 




Figure 2. Message update rale of SBP on factor graph at ith iteration. The 
left represents message updating of pY < with all the a obtained at (/ — l)th 
iteration, while the right represents message updating of oq j, 

Fig|2] describes the message update rule of SBP. As can 
be seen, all edges participate in message updates, each edge 
passes extrinsic information obtained in the last iteration from 
its neighbor edges, and then send updated message to all the 
connected bit or factor nodes. 

3) Soft Output: Soft computation after L times iteration 
takes place as 



Sout (Xi) = 2^ Pt,i ' 
t=l 



(8) 



and detection result of bit Xi is Xi — sgn (S ou t (xi)). 

4) Performance of SBP Detector: Bit error rate (BER) 
simulation results of SBP and BP on MRF defined in |6j are 
shown in Fig[3j from which one can easily draw out that SBP 
can achieve near optimal performance. 



5) Complexity Drawbacks: Although SBP achieves near 
optimal performance, the calculated amounts for per channel 
use of SBP is even higher than ML (see Tab.I), which seriously 
prohibits for its use in practical scenarios. 




Average receive SNR in dB Average receive SNR in dB 

Figure 3. BER performance comparison of BP based detectors in | 6 | (BP 
on MRF) and in | 8 | (SBP), BPSK modulation, L = 5, N t = N r = 4 of the 
left while N t = N r = 8 of the right. 



IV. Relaxed BP 
A. Edge Selection Policy for Complexity Reduction 

From © and one can easily draw out that calculation 
complexity mostly lies in the message updating of f), while 
message updating of a contains only N r — 1 additons and 
contribute little complexity. As represented in FigJ3] when 
updating pj\ from fj to X{ at Zth iteration, all the neighbor 
edges participate in and pass afj ^ obtained in the last 
iteration, where t = 1, 2, • • • , MN t and t ^ i . 

We propose that for complexity reduction, only M + 
Rd 2 (M — 1) neighbor edges are selected when updating 
where R dl is a coefficient correlated with relax degree (defined 
as N t - R dl - 1) and R dl = 0, 1, • • • , (N t - 1), R d2 is 
another coefficient and R d2 = 0, 1. The R dl M neighbor edges 
correspond to R dl largest sub-channel gains among all the 
Nt elements in hj except the sub-channel gain hj ku), and 
Rd 2 (M — 1) neighbor edges are the edges with the same 
sub-channel gain hjUi)- I n tne following context, ^ = 
■02*! ' ' ' jV'jjd} denotes the set containing subscripts 
of the R D (R D = R dl M + R d2 (M - 1)) neighbor edges, s' 
denotes the vector which contains the bits corresponding to 
the selected edges and RBP{R dl , R d2 ) denotes the relaxed BP 
algorithm with coefficient R dl and R d2 . 

Under the edge selection policy, (0 becomes 

^K^t{^ (s ' )+ E 

- s maxL,(s')+ E afjA, ( 9 ) 

where Dj (s') is the primary issue we need to approximate. 

Two extreme cases are RBP(iV t -1,1) and RBP(0,0), the 
former turns out to be SBP and the latter is the most simplified, 
we will discuss RBP(0,0) alone, and in this case 

/Sfjf? = Dj (s' \s': Xi = l)- Dj (s' | s' : Xi = -1) . (10) 



The message update rule of /3j \ in RBP is shown in FigHl 
the dashed line means that there is no message passed on this 
edge. What's more, the message update rule of af^ in RBP 
is the same with SBP as shown in the right part of FigJ3] 




/,□ /,□ 

Figure 4. Message update rule of /3^] in RBP at ith iteration. The left 
represents message updating in RBP with only Ro of the a obtained at 
(I — l)th iteration, the right represents the case RBP(0,0). 

B. Gaussian Approximation with Feedback Information 

Under the edge selection policy, when updating pj\ and 
calculating Dj (s'), the signal model is represented by 

yj = hj Mi )Xi+ ^2 h jMt) x t+ ^2 h ]Mt) x t+ n J 

= h jMi) Xi+ ^ hj,k(t)Xt + Zj,i, (11) 

where Zj i is viewed as 'interference' or noise, as in the 
literature of multi-user detection. Gaussain approximation is 
applied here as Zj,i ~ CM (u Zj i5 \ 

The key points in this sorts of algorithms are the modeling 
of mean and variance. We argue that a priori messages ob- 
tained in the last iteration can be adopted in the next iteration 
as feedback information. Therefore u z can be formulized as 

= E h JMt) ■ (2P W {x t = 1) - l) (12) 

t^i,tp& jti 

at Ith iteration, where p"' [xt) can be calculated by the mesage 
a[ l }j (see d3j). And for the variance, we formulize as 

= E I h i> k( -t) I 2 -var(a; t ) + a 2 

= E I h iMt) I 2 +°\ (13) 

here the results of last iteration are not used for var (xt) in 
view of the fact that the approximation of Xf's variance is 
more sensitive to the output and only variance of the priori 
distribution before the first iteration is enough. The modeling 
of mean and variance is different from [9 1, where they update 
both. 

After modeling of (fT2l and ( fT~3T >. the function Dj (s') in © 
is thus 

Dj ^ = ~2^~ " y i~ h iMi) x i~ E h iMt) x t- u( z~P II 2 ■ 

(14) 



Thereafter fifj can be calculated out from (TBI and ©. 
Especially, for RBP(0,0) there is 



(0 



-ft 



(15) 



As for message a, the updating rule is the same as 



C. MMS£ Detector Cascaded RBP 

In Q the author proposed a algorithm that use pseudo priori 
information obtained from linear detector, while this algorithm 
is essentially an improved BP based detector on MRF. Since 
BP on MRF achieves poor performance, we take the cue from 
||7)'s algorithm and apply it into our factor graph model. 

The main idea is to initialize all the message a by just one 
MMSE detector, that is, a priori message before first iteration 
otf] . MMSE detector is a linear filter defined as 



smmse 



(h*h 



I 



H* 



y. 



(16) 



which has comparatively very low complexity (here I is a 
N t x N t unit matrix). Thereby the priori distribution of x 
(initial value when L — 0) can be approximated as 



[xi] oc exp 



SMMSE k 



9rr 2 



(17) 



where SMMSE k(i) is the fc (i)th element of smmse defined 
in ( fT6] >, and u\ /[MSEk ^ is the element of the following nosie 
covariance matrix in k (i)th row and k (i)th column: 



K 2MJV/SB = (H*H + ( x 2 .l) 
Above this, a priori message is 

(0) _ 2~fc (s M MSE k(i) ) 



(18) 



(19) 



' MMSE k{i} 



After each a priori message of a\ J is obtained from MMSE 
filter, the messages pass to the factor nodes and iterate L times 
in the same way of RBP, and this is called MMSE-RBP. 

D. Performance of RBP and MMSE-RBP 

We provide simulation results for the proposed algorithms, 
which are shown in Fig[5] and Fig|6] BPSK modulation is 
adopted here, thus Rd 2 is insignificant and not considered. 1 8 1 
also proposed an edge based BP algorithm, denoted by EB, 
we compare it with RBP at different Rd 1 . As can be seen, the 
proposed RBP achieves much better performance than EB in 
[8 1, while the complexity is no higher, as will be shown latter. 
What's more, as SBP is just RBP(A r t — 1,1), we can point out 
that the BER of RBP will approach SBP's asymptotically as 
increase, which is partly shown in the figures. 

As for MMSE-RBP detector, its performance is nearly the 
same as MMSE-SIC when SNR belows 12dB in 4 x 4 systems, 
while it is so amazing that MMSE-RBP even outperforms SBP 
both when Rd 1 = and when Rd ± = 1 in 8 x 8 systems. 
Despite there are error floors due to approximation and edge 
selection, the performance of MMSE-RBP is much satisfactory 
in view of the fact that its complexity is much lower than SBP. 




- MMSE-RBP, (^=1 

MMSE-SIC 
"SBP 
ML 



Figure 5. 
tion, A^t : 
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BER comparison of different BP based detectors, BPSK modula- 

: N r = 4, L = 7. 




Figure 6. 
tion, Nt ■ 
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BER comparison of different BP based detectors, BPSK modula- 

: N r = 8, L = 5. 



When numble of circles becomes large, BP on loopy graph 
converges very slowly and the performance can not be guaran- 
teed, which is still an open problem. Intuitionistic explanation 
for the excellent performance of MMSE-RBP at low SNR is 
that, it cut off all the 'redundant' edges and forms a dynamic 
graph which has much less circles, while SBP passes mesage 
on all the edges and in both directions. 

V. Complexity and Convergence Analyses 

TableJI] gives comparison of computational complexity of 
the detectors mentioned above, where C (RBP) denotes the 
complexity of RBP in this item. One can see that SBP has 
even higher complexity than ML, while RBP and MMSE-RBP 
have much lower complexity if Rd 1 is small. 

For convergence, average mutual information (AMI) is one 
of the most accurate measures for tracking the convergence 



Table I 

Complexity of different algorithms per channel use 



Algorithm 


multiplications 


additions 


comparisons 


ML 


2 MNt N r N t +MN t 


2 MN t N r N t +2 MNt MN t 







SBP 


2 MN tNrNf 


( 2 MN t + ( 2 MJV t -l + 3) ML j NrNt 




- 2) MN t N r L 


RBP 


2 R o+ 1 (R dl + 1) N r 
+2 M (N t - R dl ~ 1) N T 


2 r d+ 1 (R dl + 1) N r +2 M (N t - R dl - 1) N r 
+ (2 r d (R dl + 1) + 2 M ~ 1 + 3N t ) MLN r 




- 2) MLNtN r 


MMSE-RBP 


C (RBP) + O (N?) 


C(RBP) + (N?) 


C (RBP) 


+ N t (N t - 1) 12 


RBP(0,O) 


2N r + 2 M (Nt - 1) N r 


2N r + 2 M (N t -l)N r + (2 M ~ 1 + 3N t + 2) MLN t N r 







EB in [8] 


2 MR "i +M (R dl +l)N r 
+2 M (N t - R dl - 1) N r 


2 MR dl +M + y Nr+2 M ( Nt _ ^ _ Nr 

+ (2 MR <ii +M - 1 (R dl + 1) + 2 M ~ l + 3N t ) MLN r 


(2 MR "i + 


M - 2) MLNtNr 




-ml 

- SBP 

- MMSE-RBP, R 
-RBP,R d1 =1 

MMSE-RBP, R d1 =0 
RBP, R d1 =0 

- EB in [8], R d ,=1 

- EB in [8], R =0 



EB in [8], R d ,=0 
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Figure 7. AMI comparison of different BP based detectors, BPSK modula- 
tion, N t = N r = 4, L = 5. 



Figure 8. Convergence comparison of different BP based detectors, BPSK 
modulation, N t = N r = 4, SNR = 12dB. 



behavior of iterative systems, the higher AMI is, the more 
reliable the detector is. Readers can refer to [8| for details 
about AMI. Simulation results of AMI are shown in FigJT] 
from which we can see that due to disconnectivity of the graph, 
the AMI of the proposed RBP detectors are smaller than that 
of SBR Furthermore, MMSE-RBP has larger AMI compared 
with RBP because of the additional a priori information. 

Besides the semi-analytical method of AMI, we give the 
convergence comparison of different BP based detectors with 
different iteration number, which is shown in FigJH] The 
convergence speed is different but L = 5 is enough for almost 
all algorithms in practical implementation. 

VI. Conclusions 

Form the above analysis, the proposed RBP detectors can 
achieve high performance with low complexity at large relax 
degree, and achieve near optimal performance asymptotically 
when the relax degree decrease. The special case RBP(0,0) 
possesses smallest complexity and achieves satisfactory perfor- 
mance if MMSE filter is cascaded, which is a iterative parallel 
interference cancellation method essentially, we will analyze 
it alone theoretically in another paper. 
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